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Abstract 

Cells sense external concentrations and, via biochemical signaling, respond by regulating the 
expression of target proteins. Both in signaling networks and gene regulation there are two main 
mechanisms by which the concentration can be encoded internally: amplitude modulation (AM), 
where the absolute concentration of an internal signaling molecule encodes the stimulus, and frequency 
modulation (FM), where the period between successive bursts represents the stimulus. Although both 
mechanisms have been observed in biological systems, the question of when it is beneficial for cells 
to use either AM or FM is largely unanswered. Here, we first consider a simple model for a single 
receptor (or ion channel), which can either signal continuously whenever a ligand is bound, or produce 
a burst in signaling molecule upon receptor binding. We find that bursty signaling is more accurate 
than continuous signaling only for sufficiently fast dynamics. This suggests that modulation based 
on bursts may be more common in signaling networks than in gene regulation. We then extend our 
model to multiple receptors, where continuous and bursty signaling are equivalent to AM and FM 
respectively, finding that AM is always more accurate. This implies that the reason some cells use 
FM is related to factors other than accuracy, such as the ability to coordinate expression of multiple 
genes or to implement threshold crossing mechanisms. 

Author Summary 

Signals, and hence information, can generally be transmitted either by amplitude (AM) or fre¬ 
quency (FM) modulation, as used, for example, in the transmission of radio waves since the 1930s. 
Both types of modulation are known to play a role in biology with AM conventionally associated with 
signaling and gene expression, and FM used to reliably transmit electrical signals over large distances 
between neurons. Surprisingly, FM was recently also observed in gene regulation, making their roles 
less distinct than previously thought. Although the engineering advantages and disadvantages of AM 
and FM are well understood, the equivalent question in biological systems is still largely unsolved. 
Here, we propose a simple model of signaling by receptors (or ion channels) with subsequent gene 
regulation, thus implementing both AM and FM in different types of biological pathways. We then 
compare the accuracy in the production of target proteins. We find that FM can be more accurate 
than AM only for a single receptor with fast signaling, whereas AM is more accurate in slow gene 
regulation and with signaling by multiple receptors. Finally, we propose possible reasons that cells 
use FM despite the potential decrease in accuracy. 


Introduction 

Cells are exposed to changing environmental conditions and need to respond to external stimuli with 
high accuracy, e.g. to utilize nutrients and to avoid lethal stresses m- To represent (encode) chemicals 
in the environment, either ligand-bound receptors trigger chemical signals or ion channels allow entry of 
secondary messengers. These in turn activate transcription factors (TFs), which then regulate target- 
protein production (decoding). In eukaryotic cells, the conventional view is that the level of signaling 
within the cell directly encodes the external stimuli, with consequent gradual changes in the nuclear 
TF concentrations. This is effectively an amplitude modulation (AM) mechanism [5HTU], However, 
recent single-cell experiments also show pulsating signals gsqihih and bursty entry of TFs into the 
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nucleus nnmnHiii, in close analogy to frequency modulation (FM). (Note that, although there is 
no modulation of an underlying carrier wave as in radio broadcasting Il8j . the AM/FM terminology is 
commonly used in quantitative biology mans]-) Although several hypotheses have been put forward, the 
benefits and detrimental effects of either type of response remain largely unclear. 

There is experimental evidence that both types of modulation occur in gene regulation. For example, 
take the budding yeast Saccharomyces cerevisiae. Under oxidative stress the nuclear concentration of 
transcription factor Msn2 is proportional to the H 2 O 2 concentration, suggesting an AM mechanism (Fig. 
HK,B) [10j - However, in response to a calcium stimulus, Crzl, which is normally cytoplasmic, enters the 
nucleus in unsynchronized bursts, regulating at least a hundred target genes (Fig. [Tp) [15] . The level of 
stimulus affects only the frequency of bursts, not their amplitude and duration, which implies FM (Fig. 
[Tp and inset) jToinTFj . Similarly, Msn2 and its homologue Msn4 exhibit FM under glucose limitation [TD]. 
Bursty FM is also found in bacteria and mammals, indicating that this is a general modulation scheme 
across different cell types. For example, during energy-depletion stress, the bacterium Bacillus subtilis 
activates the alternative sigma factor cr B in discrete stochastic pulses, regulating around 150 downstream 
genes [20]. In addition, isoform NFAT4 in activated T-cells shows similar behavior [21] , 

What are the relative benefits of AM and FM? One important issue is the susceptibility to noise, which 
affects the accuracy of sensing. For example, in broadcasting radio signals it is well known that FM is less 
affected by noise than AM. This is because noise mainly deteriorates the amplitude, which is where the 
information is stored in AM. A similar argument also favors action potentials in communicating neuronal 
signals over long distances [22]- In contrast, it has been hypothesized that for other cell types, such as 
yeast, the bursty nature of FM may introduce more noise than AM, so that AM might be preferable 
(Fig. ]2j\,B) m- However, two recent articles (which we discuss below) disagree with this and suggest 
that FM may still be more accurate [23 ] l24]. In addition, it is important to remember that there are 
often other factors than noise minimization. For example, it has been suggested that, in situations where 
multiple genes need to be up or down regulated, FM can provide greater coordination and reliability (Fig. 

had) [rang. 

Mora and Wingreen considered a model for a single receptor embedded in a cell membrane and 
compared the noise in the output for two signaling mechanisms: continuous (CM) and bursty (BM) 
modulation [23] . In CM, the receptor signals continuously whenever a ligand is bound, whereas in 
BM the receptor signals for a short, fixed-sized burst only upon binding of a ligand. As we explain 
below, for multiple receptors these mechanisms become equivalent to AM and FM, respectively. By 
considering integral feedback control, a common network for sensing concentration ramps and precise 
adaptation [25l - [27] . it was found that, for fast binding and unbinding, the noise in CM can be twice that 
from BM, suggesting that FM leads to greater accuracy. Despite this unexpected result, there are two 
key points that need further clarification. First, the response was only calculated to lowest order in the 
small-ramp parameter, thus neglecting any time dependence of the noise. Second, the derivation solely 
relied on the small-noise approximation, which might work well for fast signaling, but could be inadequate 
for slow gene regulation. 

Similarly, Tostevin et al. found biologically relevant parameter regimes of promoter switching in gene 
regulation in which an oscillating input can produce a more constant and hence less noisy protein output 
level than a constant input with noise [H]. Although interesting, this model is restricted to decoding and 
linear pathways, and requires fine-tuning. Its general applicability remains unclear, such as whether an 
oscillatory input signal can be replaced by random bursts and still remain more accurate than a constant 
input. In fact, oscillating signals are well-known to maximize target responsiveness while bypassing 
desensitization from constant signals [28). They also globally entrain with its period robust to noise [29]. 
Such oscillators are found in circadian clocks, segmentation clocks, cell cycle, p53 DNA repair pathways, 
as well as nuclear factor NF-kB, epidermal growth factor ERK, cAMP and Ca 2+ signaling [T7I15UH59] . 
This leaves the question of the relative benefits of AM and FM (with respect to random bursts) largely 
unanswered. 
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Figure 1. Experimental evidence for amplitude and frequency modulation. (A and B) 

Example data showing amplitude modulation from [10]. (A) Single-cell nuclear localization of Msn2 
transcription factor in response to H 2 O 2 stress as a function of time. The stimulus profile (input) is a 
step change applied at t = 0 (inset) which applies to all figure panels. (B) Average time trace for 
different concentrations of H 2 O 2 stress. (C and D) Example data showing frequency modulation 
from [T5]. (C) Single-cell nuclear localization of Crzl in response to calcium stress as a function of time, 
showing bursts of Crzl. (D) The average frequency of bursts against calcium concentration, showing an 
increased frequency with increased concentration. (Inset) Burst duration distribution for low (blue 
bars) and high (red bars) concentration. Both histograms are well described by the Gamma distribution 
h{t) = te~ t l Tb , with Tf, = 70s (black solid line), demonstrating that pulse duration is independent of 
calcium concentration. Experimental data in arbitrary units (AU) of fluorescence. 


Here, we aim to investigate the advantages and disadvantages of CM and BM (AM and FM) for 
encoding and decoding of constant concentrations and ramps. To build intuition, we start with a single 
receptor/ion channel (CM and BM). We consider concentration sensing by a linear pathway, allowing 
us to gain exact results for different temporal regimes (as suitable for fast signaling and slow gene 
regulation). To provide analytical results, we extend the single-receptor model for ramp sensing by 
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Figure 2. Advantages and disadvantages of amplitude and frequency modulation. AM may 

be less noisy than FM (A,B), but FM may allow coordinated expression of many genes (C,D) |T5jfl9l. 

(A) In AM, low/high stimuli result in low/high levels of transcription factor (TF) inside the nucleus. 

(B) In AM, different nuclear TF concentrations (blue and red curves) lead to gene expression of 
proteins A and B (see orange and green promoter functions respectively) with variable ratios (order of 
dot and square changes). (C) In FM, the stimulus strength only affects the frequency of bursts, not 
their amplitude. (Inset) Schematic of TF (purple dots) binding promoter Pa of gene A (orange) and 
promoter Pb of gene B (green) with different binding strengths. (D) In FM, the nuclear TF 
concentration is always the same during a burst, only the frequency of occurrence changes. As a 
consequence, the protein ratio stays constant. 


Mora and Wingreen. First, we introduce an alternative mechanism to integral feedback, the incoherent 
feedforward loop (another common pathway motif for ramp sensing and precise adaptation |40H42j l. 
This allows us to generalize the model to more than one pathway. Second, by explicitly including the 
time-dependence of signaling noise, we are able to provide first-order analytical results for the accuracy 
of ramp sensing. Taken together, a general principle emerges, favoring BM for fast signaling and CM 
for slow gene regulation. Finally, we generalize to many receptors and ion channels, a far more realistic 
situation for biological systems, allowing us to make connection with AM and FM. While we found that 
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AM is generally more accurate than FM, we speculate why cells may still utilize FM in certain cases of 
gene regulation. 


Results 

Cells sense external stimuli with cell-surface receptors and/or ion channels, which ultimately lead 
to changes in the concentration and dynamics of active transcription factors (TFs) inside the nucleus. 
Cells control the response at two different levels. Firstly, cell-surface receptors signal to regulate the 
activity of TFs in the cytoplasm. Secondly, inportin and exportin regulate the entry of active TFs into 
the nucleus, thereby regulating transcription (Fig. [314). Here, we build a theoretical model that encodes 
information from an extra-cellular environment in an intra-cellular representation. We distinguish two 
ways of encoding this information: continuous modulation (CM) and bursty modulation (BM). Once the 
information is encoded, various proteins can act together to implement a response (decoding), involving 
regulatory networks. To provide a general analysis for arbitrary noise we first address concentration 
sensing in a simple linear pathway using the master equation. However, to derive analytical results for 
ramp sensing and pathways with feedback we apply the small-noise approximation. We finally extend 
these models to implement amplitude (AM) and frequency modulation (FM) for many receptors or 
ion channels. Accuracy is assessed by comparing the protein output noise for the different modulation 
schemes, assuming that the signal is decoded by the average concentration. 

Single-receptor/ion-channel model 

Following Mora and Wingreen [23] we build a single-receptor model that implements CM and BM. 
We call the extra-cellular species c, which is encoded intra-cellularly by the signaling rate u. Assuming 
we are in the fast diffusion regime in which each ligand molecule can bind the receptor only once, the 
receptor can be in either of two uncorrelated states: on when bound and off when unbound. This allows 
the receptor activity, r(i), to be written mathematically as a binary response, which takes value f in the 
on state and 0 in the off state. The extra-cellular concentration c affects the unbound time intervals t u . 
such that the binding rate is given by (t u ) 1 = fc_|_c(t), where k + is the binding rate constant. In contrast, 
the bound time intervals, 77 ,, are exponentially distributed random numbers with average ( 77 ,) = fc_, 

where k_ is the unbinding rate constant, which is independent of the extra-cellular stimulus concentration 
(inset in Fig. [3K)- As for ion channels, some are ligand-gated or regulated by receptors, while others 
are voltage-gated and hence dependent on action potentials [43] ■ In all these cases the stimulus affects 
the opening or closing times. In CM downstream proteins are produced with a constant rate a during 
each on time interval, which leads to a signaling rate rtcM = ctr(t), while in BM £ = akZ 1 molecules are 
produced instantly at the moment of binding with rate «bm where tf are the binding 

times (Fig. [3)3). This choice for £ allows a meaningful comparison of CM and BM as both produce, on 
average, the same amount of intracellular species. 

General approach to concentration sensing exhibits two regimes of accuracy 

In order to provide a general result for arbitrary input fluctuations, we write down the chemical master 
equation. For simplicity, we only consider concentration sensing with c(f) = co, but the model can also be 
applied to ramps. Furthermore, we assume a linear pathway in which the receptor/ion channel activity 
r directly regulates an output species with copy number n (with production rate u and degradation rate 
7) (Fig. EP, left). Since the receptor/ion channel activity is a two-state system (on/off), there are two 
resulting master equations for CM (one for each state) describing the probability of being in the on and 
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Figure 3. Schematic view of signaling and gene regulation. (A) Cartoon of S. cerevisiae in 
presence of extracellular calcium, considered a paradigm of bursty frequency modulation. Calcium 
enters through plasma-membrane ion channels and can be stored (released) in (from) vacuoles. 
Intracellular calcium activates calcineurin, which dephosphorylates Crzlp. Once dephosphorylated, 

Crzl binds inporting Nmd5p and enters the nucleus. Exportin Msn5p subsequently removes Crzl from 
the nucleus. Cytoplasmic calcium pulses may correspond to Crzl bursts in the nucleus m- Red arrows 
indicate movement while blue arrows stand for chemical signaling. (B) Single receptor/ion channel 
activity, r(t) (blue line), depends on the concentration of extra-cellular stimulus c. The signaling rate u 
differs between continuous (CM) and bursty modulation (BM). In CM, u is constant rate a during 
bound intervals, with pb the probability of being bound. In BM, £ molecules are realized at the time of 
binding with ^bursts the duration between consecutive bursts (binding events). (C) Different regulatory 
networks. Linear pathway used for concentration sensing. Incoherent feedforward loop and integral 
feedback control allow chemical ramps to be sensed. 

off states, i.e. p on (n,t) and p 0 g(n,t): 

dponin, t ) _ 7 ( n + 1 )p OI1 ( n + l,t) + ap on (n -l,t) + k + cp oS (n,t ) - (yn + a + k_)p on (n,t), (la) 
at 

dp 0 s{n , t) 


dt 


7 {n + l)p 0 e(n + l,t) + k-p on (n, t ) - (jn + k+c)p oS (n, t). 


(lb) 
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Note that a > fc_, so molecules are generally produced in the on state. In BM, instead, the master 
equations which describe the probabilities p on (n , t) and p 0 ff{n, t ) of having n proteins at time t, are given 
respectively by 


dpcm(n, t) _ ^ n + + 1 , t) + k+cp oS {n - (,t) - (jn + k-)p oa (n, t), ( 2 a) 

at 

^^dt' ^ = + + M) + k-Pon{n , t) - {"in + k+c)p 0 s{n , t), (2b) 

with burst size £ a positive integer. We solve Eqs. (flail and (libit with generating functions and simulate 
Eqs. (l2al) and (I2bl) with the Gillespie algorithm (see Materials and Methods). 

Simulations via the Gillespie algorithm show different outcomes for fast (small-noise approximation 
limit, Fig. |U4,B) and slow (Fig. HP,D) dynamics of the receptor. For fast switching (fc + co,fc- 7 ), for 
both CM and BM, the probability has an unimodal distribution (Fig. [4j3) . On the other hand, in the 
slow switching regime (fc+c, fc_ C 7 ), the probability distribution becomes bimodal for CM and unimodal 
with a long tail for BM, leading to drastically increased noise (Fig. HP). The unimodal distribution for 
BM, which is simply due to the use of infinitely short pulses, would become bimodal for finite width 
pulses. 

In order to classify the different dynamics and to compare CM and BM for arbitrary noise, we require 
information on the probability distribution of n output proteins. In particular, we study the average, 
variance and skewness (the latter is encoded in the third moment) of the distribution for both CM and 
BM. Constraining the average output of CM and BM to be the same (Fig. [5j\,B) , we identify two 
regimes for fast dynamics: fc+co < k- (Fig. [5p) and fc+co > k- (Fig. [5p). Specifically, for fc+co < fc_, 
BM is more accurate (Fig. [5p, inset), while CM is generally more accurate when k + co > k- (Fig. [5p, 
inset), except for minimal burst size (£ = 1). However, for slow dynamics (and hence large noise), CM is 
always more accurate than BM. The study of the third moment shows that, for slow switching and hence 
bimodality, BM has large asymmetry (Fig. EP,F). 

These observations can be explained as follows, using the fact that the receptor/ion channel can 
only detect information from the extra-cellular environment during unbound (off) time intervals, as the 
extra-cellular stimulus only affects the binding rate (Fig. [3]). For fast dynamics, the two regimes can 
be understood by comparison with maximum-likelihood estimation (MLE), the most accurate strategy 
for encoding [44] . MLE estimates the ligand concentration cml = k+ l (t u ) _1 from the average unbound 
time interval (t u ). The bound time intervals are discarded as they only contribute noise [44]. BM, which 
produces fixed-size bursts at the times of binding, approaches MLE when the bound intervals are shorter 
than the unbound intervals. In this case, the times of the bursts effectively estimate the unbound time 
intervals (Fig. 3B, bottom) and BM is more accurate than CM. However, when the bound intervals are 
longer than the unbound intervals, BM cannot estimate the unbound time intervals anymore and becomes 
less accurate than CM. Since CM produces protein during the bound intervals, it signals according to 
the average receptor activity pb = ( 77 ,) /((-n,) + (r u )) (Fig. 3B, top). Hence, CM effectively contains 
information on both bound and unbound intervals, and thus can still provide a reasonable estimate of 
unbound time intervals. An interesting exception is akZ 1 = ( = 1, for which BM becomes slightly more 
accurate than CM. In the latter case, since the rate of protein production during a bound interval in CM 
is very low, there is uncertainty as to whether CM actually produces protein or not, which reduces its 
accuracy. In contrast, for slow switching the burst size needs to increase since BM produces the same 
level of protein as CM. Hence, BM is always less accurate than CM, independent of whether bound or 
unbound time intervals are longer. While we analytically demonstrate the connection with MLE for fast 
dynamics in the next section, an extended discussion without comparison to MLE can be found in SI 
Text and S1-S3 Figs. 
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Figure 4. The two regimes in the linear pathway model based on the master equation. 

(A-B) fast (fc + co = 20s -1 , fc_ = 100s -1 , 7 = 0.1s -1 , a = 100s -1 , £ = 1) and (C-D) slow 
( k+co = 0.01s -1 , k- = 0.05s -1 , 7 = Is -1 , a = 25s -1 , £ = 500) switching. (A,C) Protein number as a 
function of time from Gillespie simulations for CM (blue lines) and BM (red lines). (B) The probability 
distribution for n target proteins is unimodal for both AM (blue) and FM (red). (D) The probability 
distribution is bimodal for AM (blue) and remains unimodal for BM (red) but with a long tail in the 
slow switching regime. 

Small-noise approximation to ramp sensing confirms two regimes for fast dy¬ 
namics 

To further investigate fast dynamics, we extend an analytical model for ramp sensing in the small-noise 
approximation [23]. Considering the single-receptor described in Fig. [3]A,B, we linearize the system by 
averaging over a time much larger than the binding and unbinding times. We further assume exponential 
distributions for and r„ so that ((£r&) 2 ) = (t{,) 2 = kZ 2 and (( St u ) 2 ) = (r„) 2 = (fc + c(f)) -2 , where c(t) 
increases only very slowly with time (see below). Hence, signaling noise arises in CM due to variable 
bound time intervals (ignoring stochastic production of protein during bound intervals), while in BM the 
binding times (bursting times) vary. Without loss of generality, we set a = k_, which is equivalent to 
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k+ c o < k- 


k+ c 0 > k _ 



Frequency f 


Frequency f 


Figure 5. First three moments of the protein distribution in concentration sensing from 
the master equation. Averages (A,B), variance (C,D), and skewness (E,F) as a function of the 
frequency of binding events, / = ft+co/(l + k+co/k-). (Insets) Magnification of small-noise 
approximation region (fast switching). Analytical results for CM (blue) and numerical results for BM 
(red) as function of the frequency of binding events (logarithmic scale). Two regimes are shown: 
k- = 10 fc + co (a = 100 s _1 ,7 = Is -1 , £ from 1000 to 1) (left column) and fc_ = 0.1 fc+co 
(a = 10s -1 ,7 = Is -1 , £ from 1000 to 1) (right column). Averages from CM and BM are constrained to 
be equal, i.e. £ = ak~ . Variances of CM and BM exhibit two different regimes for fast switching: for 
k+co < k- BM is more accurate than CM (inset in C), while for k+co > k- CM is generally more 
accurate (inset in D), except for £ = 1. Third moments show that, for large noise, the probability 
distributions become asymmetric. 


£ = 1. Hence, as we show in SI Text, for averaging time much longer than and (k+c(t)) 1 , the 
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average and autocorrelation (variance) of u(t) are given by [231 


with ( Su(t )) = 0 and 




k + c(t ) 


(6u(t)6u(t')) = g 


1 + k+c(t)/k- ’ 
k + c(t) 


(1 + k+c(t)/k-)' 


■S( i-t'), 


(3) 

(4) 


= ri + <(dr b ) 2 )/(T b ) 2 =2 CM 

9 [1 + ((<5r b ) 2 ) / ((St u ) 2 ) =1 + [k + c(t)/k-] 2 BM. 

Note that only the variance differs between CM and BM. In particular, in Eq. Jo]) the ratio k+c(t)/k- 
determines whether g is larger in BM or CM, which ultimately determines which scheme leads to the 
least noise. BM has the lower noise only when k+c(t) < fc_, i.e. when (r b ) < (t u ). In particular, in the 
limit of fast unbinding ( k+c(t ) -C fc_), the signaling noise for CM is twice as large as for BM. 

Sensing temporal ramps, i.e. the change of concentration with time, is crucial for locating nutrients 
and avoiding toxins. We start by considering a stimulus whose concentration is constant for t < 0 and 
increases linearly and slowly in time after t = 0: 


c(t) 


cq t < 0 

cq + c\t t > 0, 


( 6 ) 


for constants Co and c b with c\t <C co- By applying Eq. J6]) to Eqs. 
rewritten to first order as 


u{t) 


uq + u\t + Su t > 0 
uq + 5u t < 0, 


m , the signaling rate can be 


(7) 


where uq, u\ are functions of co and ci, and 5u is the noise described by ( Su(t)6u(t ')) (given in SI Text). 
The condition at -C co is necessary so that u behaves linearly in time with u\t -C u o. Under this 
condition, the factor ^bm of Eq. becomes 


5bm — 1 + 


T, + O 0 

fc 2 


2 fc 2 


+ C 0 Ci 


^BM 


( 8 ) 


where 5 bm is given by g^M f° r a constant external concentration. We now assume that the extra-cellular 
stimulus is encoded in the signaling rate u which affects the production of two output proteins with 
concentrations x and y. Specifically, we compare the output noise of x and y between CM and BM using 
the incoherent feedforward (Fig. [3]C, middle) and integral feedback (Fig. [3]C, right) loops. 


Incoherent feedforward loop 


The incoherent feedforward loop is a network motif in which u directly affects two outputs x and y, 
while y inhibits x (Fig. |3]C, middle). The loop provides precise adaptation to a step-change in stimulus 
and can also be used for ramp sensing. Mathematically, we use the following two coupled stochastic 
differential equations, 


dx 

—— = k 

dt 



dy 

dt 


u - k y y, 


(9) 

( 10 ) 
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where k x is the rate constant for production and degradation of x, while k y is the rate constant for 
degradation of y, and f(u) and g(y) are specified functions. In order to have adaptation the variable y 
needs to evolve slower than x, which requires k x > k y . Here we choose f(u) = e bu and g(y ) = e bkyV , 
where constant b has units of time. This allows us to obtain an analytic solution (see SI Text for details). 

Integral feedback loop 

The integral feedback loop }23l is another network motif for precise adaptation and ramp sensing. 
Here, u affects x only (the main output), while x activates y and y inhibits x (Fig. [3p, right). The 
general equations for this model are given by 

= uf(y) - k x x, (11) 

§ = M*-1), (12) 

where k x is the rate constant for degradation of x, k y is the rate constant for production and degradation 
of y satisfying k x > k y , and f(y) is a monotonically decreasing function of y. Specifically, we choose 
f(y) = e~ by , where b is a dimensionless constant. This again produces an analytic solution (see SI Text 
for details). 

Small-noise approximation 

To analytically solve Eqs. © and dll for the incoherent feedforward loop, and Eqs. m and m 
for the integral feedback loop, we linearize these equations within the small-noise approximation, and 
assume that we are in the fast-switching regime. This allows us to find analytic solutions in a particular 
time window and under certain conditions which we define in SI Text. Specifically, for the incoherent 
feedforward loop in the small-ramp regime, the average values of ( u(t )), (x(t)) and (y(t)) are determined 
by the differential equations Eqs. (19I10D . Although there are no steady states for ramps, (x(t)) and (y(t)) 
show time-dependent stable solutions 


(x(t)) 
<: vit)) 


uo 

ky 


U\ U\t 

ky + ky ' 


(13a) 

(13b) 


Introducing x — (x) + Sx and y = (y) + Sy into Eqs. © and (flT)l) with subsequent linearization the 
variance of the target-protein copy numbers can be derived (see Materials and Methods). To first order 
in small-ramp parameters the variances of x for both types of modulation are 


CM = A 


5cm uo 


9 bm m o 


1 — 2cofc+ /k- 


■u\ + 5cm(1 - 2k + co/k-)uit 


1 — 2cok+/k- + 3cQk^_/k_ 
2 k v 


u\ + (l — 2k + co/k- + 3fc^.Cg//c^) u\t 


(14a) 

(14b) 


2 fmx 

a fc2 c ky . . ^ 

where A = 2 (k x +k )(i+fc + c 0 /fc ) 2 ’ anc ^ 5 cm an( ^ 5 bm are parameters discussed in Eqs. (J5J) and (| 8 )) . The 
corresponding results for species y are provided in Eqs. (S56) and (S58), and plots for species x and y 
are shown in Fig. ©3,D. 

Consistent with the master equation, these results show again two regimes: ramp sensing is more 
accurate for BM if fc + Co < fc_, while CM is more accurate otherwise. For a constant environment 
(zeroth-order with C\ = U\ = 0) the regime is largely determined by the factor g. If k + cg < k„, 
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Figure 6. Two regimes in incoherent feedforward loop based on the small-noise 
approximation. Output noise, i.e. relative variance of x (top) and y (bottom), as function of the 
non-dimensional ramp time uit/uo for fc + co < fc_ i.e. (t&) < (t u ) (left) and fc+co > k- i.e. (r^) > (t u ) 
(right). CM and BM are shown by blue and red lines respectively. (A,B) BM is more accurate than AM 
for fc + Co = 10 7 s -1 and fc_ = 6.7 x 10 7 s -1 . (C,D) CM is more accurate then BM for fc+co = 10 7 s -1 and 
k _ = 6.7 x 10 6 s -1 . Remaining parameters: k + c\ = 10 5 s -2 , k x = 5s _1 and k y = 10s _1 . 


3bm = 1 + ((^Tb) 2 ) / (<5 (t u ) 2 ) < 2 (see Eq. (J5])), and BM is more accurate than CM with gcM = 
1 + ((<5rf,) 2 ) / ( Tb ) 2 = 2 (Fig. [HJA,B). This is because the variability of the bound intervals ((<5rf,) 2 ) can 
be eliminated in BM (but not in CM), and the unbound intervals are well approximated by the duration 
between bursts (Tb urs t s in Fig. 3). For k + co <C fc_, BM effectively implements MLE. In contrast, CM 
is more accurate for k + cg > fc_, where <7 cm = 2 and <7 bm > 2 (Fig. [5p,D). This is because BM con¬ 
tains no information on unbound time intervals, while CM still contains some information through the 
probability of being bound (pb in Fig. 3B). These results also apply to ramp sensing since the accuracy 
of the downstream proteins (decoding) relates again to the factor g and hence to the ratio between the 
bound and unbound time intervals. The integral feedback loop in Eqs. m and m shows very similar 
behavior (provided in SI Text). The validity of our analytical results are confirmed by simulations of the 
stochastic differential equation for both pathways in |S4 Fig| and |S5 Fig| 
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AM is more accurate than FM for multiple receptors/ion channels 

To address the question of whether AM or FM is more accurate in encoding and decoding, we con¬ 
sider a straightforward generalization to multiple receptors (or ion channels) (see SI Text and |S6 Fig| 
for details). AM can be obtained by considering unsynchronized CM receptors. In contrast, the experi¬ 
mentally observed sporadic bursts of nuclear translocation jT0l[23| and hence FM might be explained by 
synchronized receptors that individually operate with BM. 

For N unsynchronized (us) receptors, the resulting average and variance of the signaling rate are 
(u(t))x = N (u(t)) 1 and (6u(t)5u(t'))™ = N (6u(t)Su(t')) 1 in terms of the single-receptor quantities. 
Consequently, the relative variance, given by the variance divided by the average-squared, scales with the 
inverse of the number of receptors (N). On the other hand, for N synchronized (s) receptors, the average 
and variance of the signaling rate are given respectively by ( u(t)) s N = N (u(t)) 1 and (Su(t)Su(t')) s N = 
N 2 (5u(t)Su(t')) The relative variance is now independent of N. Hence, unsynchronized receptors (AM) 
have a reduction of noise by a factor N compared to synchronized receptors (FM). 

For slow dynamics, or fast dynamics with fc + c > CM is generally more accurate than BM (at 
least for £ > 1), and with N receptors, AM is more accurate than FM by an even larger margin. In 
contrast, for fast dynamics with fc + c < fc_, BM is more accurate than CM by at most a factor of 2 (Eq. 
([5])). But since AM is N times more accurate than CM, AM becomes more accurate for encoding than 
FM for more than two receptors. Since our results from the previous sections show that larger signaling 
noise leads to larger output noise, the same rule emerges for decoding. 

From a physical point of view, how can receptors act in a synchronized fashion? Receptors may be 
coupled by adaptor proteins or elastic membrane deformations, allowing them to act cooperatively mm- 
In conclusion, while for fast dynamics (small-noise approximation) BM can be more accurate than CM 
up to a factor of two, two receptors/ion channels are sufficient for AM to become more accurate than 
FM. Since cells have thousands of receptors and ion channels, AM becomes the most accurate modulation 
scheme. 


Discussion 

Cellular responses to extra-cellular stimuli involve both encoding the external stimuli by internal sig¬ 
nals (which is normally fast) and subsequently decoding via the regulation of protein levels (which is 
normally much slower). The internal representation of the external signal falls into two broad categories: 
continuous/amplitude modulation (CM/AM), where bound receptors continually signal and the inter¬ 
nal concentration itself encodes the external signal, and bursty/frequency modulation (BM/FM), where 
receptors only signal when first bound and the signal is encoded in the frequency of peaks. Here, we 
compared the output noise for both types of modulation in the presence of a constant and a linearly 
increasing (in time) external concentration. Besides considering a linear pathway, we compared two non¬ 
linear network motifs: the incoherent feedforward loop and the integral feedback loop. These loops are 
ubiquitous in biological systems. For example, the incoherent feedforward loop is found in chemotactic 
adaptation of eukaryotes [40] and transcription networks in bacteria [44], and the integral feedback loop 
is found in chemotactic adaptation of bacteria mm and in eukaryotic olfactory and phototransduction 
pathways m- 

We found that, for a single receptor or ion channel, BM can be more accurate than CM for fast 
dynamics. This situation can occur when the average duration of the active on state is shorter than 
the average duration of the inactive off state (Figs. [5] and [6j). In this case, BM effectively implements 
maximum-likelihood estimation, the most accurate mechanism of sensing | !44j . If instead more time is 
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spent in the on state, then CM is generally more accurate (except when the burst size is minimal, i.e 
one). The reason behind this effect, which we analytically prove within the small-noise approximation, 
is that CM has information about both the on and off states, whereas BM only knows when a switch 
from off to on occurs. As such, CM effectively implements Berg and Purcell’s classic result of estimating 
ligand concentration by time averaging [48] (see also Discussion in [44]). In addition, we found that for 
slow dynamics CM is always more accurate than BM, independent of whether more time is spent in the 
on or off states, due to increased burst sizes (Fig. 0. Taken together our results suggest that BM should 
be more common in signaling pathways than in gene regulation. 

The generalization to multiple receptors/ion channels allows AM and FM to be compared. AM, 
which arises from unsynchronized CM receptors, has a reduced relative noise due to spatial averaging, 
while the relative noise in FM from synchronized BM receptors remains identical to the single-receptor 
result. (Note the observed nuclear bursts of approximately constant amplitude and duration support our 
FM mechanism mm-) As a result, AM is always more accurate than FM for more than two receptors 
QS6 Fig| ). Since cells have tens of thousands of receptors and ion channels, this implies that the reason that 
FM is sometimes observed in real systems must have a different origin. At least three possibilities present 
themselves. Firstly, FM can help to coordinate gene expression USES], which is particularly useful when 
hundreds of genes are controlled by a single transcription factor, such as during stress response [491451] . 
Secondly, FM can enhance co-localization of proteins inside the nucleus, providing another way to improve 
coordination of gene expression [52] . Thirdly, as with oscillatory signals, bursts can be used to activate 
transcription by threshold crossing [32( while avoiding desensitization [23]. This may then push the cell 
to differentiate into a new state (such as under starvation to initiate competence) [53]|54]. It is also 
worth noting that by using seemingly redundant isoforms (such as NFAT1 and NFAT4 during an immune 
response), AM and FM can be combined to enhance temporal information processing [21] . 

While providing intuitive insights, it is clear that our models are highly oversimplified versions of 
signaling and gene regulation in actual cells. One of the main reasons for this is that we used idealized 
delta-functions as pulses in BM (and hence in FM). However, for example, in the calcium stress-response 
pathway in Saccharomyces cerevisiae (Fig. [3j\) nuclear bursts of Crzlp are on average two minutes long 
(Fig. ID, inset). Most likely cytoplasmic calcium spikes determine the nuclear bursts (Elowitz, personal 
communication), but since the mechanism of calcium spiking remains poorly understood, such bursts 
are difficult to model. A further limitation of our models is that bursts only relate to translocation, 
whereas additional bursts may occur further downstream during transcription [55] (e.g. due to promoter 
switching [24]) and translation [56]. Future models may need to include these details. 

Our models suggest further experimental investigation in multiple areas. Firstly, the distribution of 
burst duration affects factor g (Eq. (0), so that g = 2 in equilibrium for a single-step process and poten¬ 
tially g < 2 for an irreversible binding cycle dominated by energy dissipation [23[l57j. These irreversible 
cycles are present in some ligand-gated ion channels, such as the cystic fibrosis transmembrane conduc¬ 
tance regulator (CFTR) channels and N-Methyl-D-aspartate (NMDA) receptors. These exhibit peaked 
opening distributions, which can be interpreted as evidence of broken reversibility and energy consump¬ 
tion [581159] . Such cases and their possible connection with accuracy need further investigation. In fact, 
most cellular processes rely heavily on energy consumption, including nuclear shuttling and chromosome 
remodeling, limiting the applicability of our equilibrium CM-receptor model. Secondly, coordination of 
gene expression during stress or cell-fate decisions might be another reason for implementing FM rather 
than AM. More quantitative experiments are needed to better understand this mechanism. Thirdly, closer 
inspection of Ca-independent transcription factors (as well as Ca 2+ -dependent co-regulated genes) are 
warranted in order to verify coordination of multiple genes [T5]. Finally, to see if bursts help jump start 
new cellular programs {i.e. transition into a new “attractor”), global changes in gene regulation can be 
monitored. 

A general understanding of FM may help prevent developmental defects and human diseases. Indeed, 
several biomedically relevant transcription factors, such as NF-kB, p53, NFAT and ERK, show oscillatory 
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pulsing or random bursting [I611l71l35fl36ll54j . In fact, the destabilization of regulatory circuits can underlie 
human diseases: studies suggest that the coordination of gene expression could be critical in maintaining 
the proper functioning of key nodes in such circuits. For example, the NFATc circuit is cooperatively 
destabilized by a 1.5-fold increase in the DSCR1 and DYRK1A genes, which reduce NFATc activity 
leading to characteristics of Down’s syndrome mm- However, ERK pulses are regulated by both AM 
and FM with the same dose dependence, and it remains unclear how they affect cell proliferation and 
the relevance to cancer [ 55] . 

Broadly speaking, temporal ordering (regularity or periodicity) serves at least two roles in living 
systems m- extraction of energy from the environment and handling of information. While the first role 
is well studied in terms of molecular motors at the single-molecule level, the second role is intellectually 
more difficult to understand as it requires a broader, more global understanding of cells. We believe 
that future work that combines single-cell experiments with ideas of collective behavior and engineering 
principles is most likely to be successful. 


Materials and Methods 


Master-equation model for concentration sensing 

The master equations for continuous modulation (CM), Eqs. (flail and m, can be solved at steady 
state using generating functions. In particular, we derive the first three moments of the probability 
distribution using the general model in [55] , When the system is in the on/off state, the production rate 
of species x is a 0n / 0 ff. The degradation rate 7 is independent of the state of the system. The probability 
distribution of n target proteins at time t is then described by 

d p „(n,t) = ( n _j_ i}p 8 ( n + I t) + a s p s (n - l,t) + k s Ps(n,t) - ( 777 , + + k 8 )p 8 (n,t), (15) 

at 

where s = off (on) when s = on (off). By defining the generating functions 

OO 

G s { z ) = 'Yl l Ps{n)z n , (16) 

n =0 

and using Eq. m, a solution for G s (z) can be found, which then readily gives the moments of p(n,t). 
In particular, the variance and skewness are given by 


(Sn 2 ) = J^(d z zd z G s (z)) |, =1 - (n) 2 , 

S 

(n 3 ) = V [d z zd z zd z G s (z)\ 

‘ ■* r — 1 


(17) 

(18) 


Full details are given in SI Text. 

In order to solve the master equation for bursty modulation (BM), Eqs. (I5al) and (|2bjl . we use the 
Gillespie algorithm [55] . If the system is in the on state with n proteins at time t, it can either switch to 
the off state with transition rate given by fc_/(fc_ + 771 ) or else remain in the on state and lose a protein 
by degradation. If instead the system is in the off state with n proteins at time t, it can either switch 
to the on state with switching rate k + co/(k+co + 771) and, via a burst, increase its number of proteins 
to n + C, or again remain in the same state and loose a protein by degradation. The time step between 
reactions, St, is chosen from an exponential probability distribution \e ~ XSt , with A equal to the total rate 
that at least one reaction occurs. 
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ODE models for ramp sensing 


The following method applies to both the incoherent feedforward and the integral feedback loop. To 
solve the ordinary differential equations (l9lfl2l) we linearize around stable solutions, x(t) = (x(t)) + Sx 
and y{t) = ( y(t )) + Sy, and assume that small Su leads to small Sx and Sy. Note that when sensing 
a gradually changing ramp, (x(t)} and (y(t)) are not steady states. Defining X = [a;(t) y{t)] T we can 
rewrite these equations as 


dX(t) 

dt 


+ MX(t) = 


w Su 
z Su ’ 


(19) 


where the matrix M and the constants w and z are defined in SI Text. Analytic solutions are only 
available when M is time-independent. As shown in SI Text, Eq. m can be solved and written as an 
integral, which can then be evaluated with, for example, Wolfram Mathematica 8. 
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SI Fig. First three moments of the protein distribution in concentration sensing from the 
master equation. Averages (A,B), variance (C,D), and skewness (E,F) as a function of the frequency 
of binding events, / = k + co/(l + k+co/k-). (Insets) Magnification of small-noise approximation region 
(fast switching). Analytical results for CM (blue) and numerical results for BM (red) and intermediate 
modulation IM (green) as function of the frequency of binding events (logarithmic scale). Note that this 
figure is similar to Fig. [5] in main text with the addition of IM. Two regimes are shown: fc_ = 10 k+co 
(a = 100 s _1 ,7 = Is -1 , £ from 1000 to 1) (left column) and fc_ = 0.1 k+co (a = 10 s -1 ,7 = Is -1 , 

£ from 1000 to 1) (right column). Averages from CM, BM and IM are constrained to be equal, i.e. £ 
(BM) = akZ 1 (CM) = olt & (IM). Variances of CM, BM and IM exhibit two different regimes for fast 
switching: for k+co < fc_ BM is the most accurate mechanism and CM the worst (inset in C) while for 
k+co > k- CM is generally the most accurate (except for £ = 1) and IM the worst (inset in D). Third 
moments show that, for large noise, the probability distributions become asymmetric. 


S2 Fig. Examples of time traces of receptor activity and protein copy numbers for 
different regimes. (Top) Regime fc+co < fc_ with k+c = 0.1 k- (a = 100s -1 ,7 = Is -1 ). (Bottom) 
Regime k+co > k- with k+c = 10 k- (a = 10s -1 ,7 = Is -1 ). (Left) Slow switching with £ = 400. 
(Right) Fast switching with £ = 7. Receptor activity r and protein copy numbers n(t) for CM, BM and 
IM are shown in black, blue, red and green, respectively. 


S3 Fig. Investigating accuracy based on accumulative signaling (without protein 
production and degradation). (A) Regime k+co < k- with k+c = 0.1 fc_ (a = 100s -1 ,7 = Is -1 
and £ = 7). (Left) ODE model. (Right) Stochastic protein production during Tf, in CM and IM. (Top) 
Examples of time traces. (Bottom) Histograms of number of proteins produced after 100s with 
standard deviation in legend based on 1000 simulations. (B) Analogous to (A) but for regime k+c > k- 
with k+c = 10 k- (a = 100s -1 ,7 = Is -1 and £ = 7). CM, BM and IM are shown in blue, red and 
green, respectively. 
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S4 Fig. Incoherent feedforward loop: Comparison of analytical results with simulations of 
the stochastic differential equations. (A) Averages of signaling rate u (left), species y from Eq. 

(542) (middle) and species x from (S41) (right) as a function of time. Analytic solutions Eqs. (S32), 

(543) and (12) are shown for BM in red, while a (time averaged) time-trace from a stochastic 
simulation using the Euler method is shown in orange (CM is almost identical and hence is not shown). 
(B) Corresponding variances as a function of time for k + co > k- (fc_ = 6.7 x 10 5 s -1 , k+co = 10 6 s -1 ). 
Analytic results are shown in blue for CM and in red for BM; average over time (Is) from numerical 
simulations are shown in light blue for CM and in orange for BM. (C) Corresponding variances as a 
function of time for k+co < k- (fc_ = 6.7 x 10 6 s -1 , fc+co = 10 6 s -1 ). Colors same as in (B). Remaining 
parameters: k+c\ = 10 4 s -2 , k x = 10s _1 and k y = 50s -1 . 


S5 Fig. Integral feedback loop: Comparison of analytical results with simulations of the 
stochastic differential equations. (A) Averages of signaling rate u (left), species y from Eq. (S60) 
(middle) and species x from (S59) (right) as a function of time. Analytic solutions Eqs. (S32), (S66) 
and (S65) are shown for BM in red, while a (time averaged) time-trace from a stochastic simulation 
using the Euler method is shown in orange (CM is almost identical and hence is not shown). (B) 
Corresponding variances as a function of time for k+co > k- (k- = 6.7 x 10 5 s -1 , fc+co = 10 6 s -1 ). 
Analytic results are shown in blue for CM and in red for BM; numerical simulations are shown in light 
blue for CM and in orange for BM. (C) Corresponding variances as a function of time for fc+co < fc_ 
(k- = 6.7 x 10 6 s -1 , k + Co = 10 6 s -1 ). Colors same as in (B). Remaining parameters: k+c\ = 10 4 s -2 , 
k x = 10s _1 and k y = 50s -1 . 


S6 Fig. From CM (BM) to AM (FM) for multiple receptors/ion channels. (A-D) Schematic 
of receptor activity in time. (A) AM emerges from N unsynchronized receptors or ion channels in CM 
mode. (B) N synchronized CM receptors lead to a hybrid mechanism with information encoded in the 
frequency of broad bursts of variable duration. (C) N unsynchronized BM receptors provide a dense 
series of bursts. For large N, bursts may start overlapping, leading to variable amplitudes. (D) FM 
emerges from N synchronized receptors in BM mode. (E) Relative variance for a system of 8 receptors 
with pN synchronized and (1 — p)N unsynchronized receptors, plotted for fast dynamics in the 
fc+c < regime (CM in blue and BM in red). Letters refer to panel labels (A-D). Dotted red line 
indicates uncertainty from FM for comparison. (Inset) Same for a system of two receptors only. 



arXiv: 1505.054lOvl [q-bio.SC] 20 May 2015 


Supporting Informations: Accurate encoding and decoding by single cells: 
amplitude versus frequency modulation 

Gabriele Micali , 1,2,3 Gerardo Aquino , 1,2 David M. Richards , 1 ’ 2 and Robert G. Endres 1,2, 0 

1 Department of Life Sciences, Imperial College, London , UK 
2 Centre for Integrative System Biology and Bioinformatics, Imperial College, London, UK 
3 Dipartimento di Fisica, Universita degli Studi di Milano, Milano, Italy 


TEXT SI 

CONCENTRATION SENSING BY CM RECEPTOR 


In this section we calculate the analytic solution for the master equation (Eq. ??,b in the main text) for continuous 
modulation (CM). For clarity, we repeat here the master equations for the on and off states: 


dp on {n,t) 

dt 

dposjn, t) 
dt 


7 {n + l)pon(n + l,t) + ap on (n — 1, t) + k+c p 0 s(n,t) - (jn + a + k-)Pon{n,t), 

'y(n + l)p 0 g(n + l,t) + k-p 0n (n,t) - (7 n + k+c)p oS (n,t), 


where p 0n / 0 s(n, t) is the probability that the receptor/ion channel is in the on/off state with n output proteins at 
time t, a and 7 are the production and degradation rates respectively, and k + c and fc_ are the binding and unbinding 
rates respectively. Note that the concentration of the input species (c) is now constant. Eqs. (??,b) can be rewritten 
as Eq. (??) in the main text 


dps f TI5 t') 

— - t- 1 — =7(71 + l)p s (n + 1, t) + a s p s (n - l,t) + k s p s (n,t) - (jn + a s + k s )p s (n,t), 
dt 

where s is the on/off state when s is the off /on state, and a on = a, a 0 g = 0, k on = k- and k 0 s = k+c. To find the 
solution for the first two moments of the distribution p(n,t), we now follow Mehta and Schwab pj. At steady state 
Eq. (??) becomes 


K s p s (n) = -(ra+ 1 )p s {n+ 1) - A s p s {n - 1) + (n + A s + K a )p s (n), 


(S2) 


where K s = k s /7 and A s = a s /'y. Using the generating function in Eq. (??) 

OO 

Gs( z ) = Ps{n)z n , 


Eq. (IS2I) becomes 


which implies 


which, when combined, gives 


n—0 


[(z - l)d z -A a (z- 1) + K a ] Gs{z) = Ks 
A'off G 0 ff— I< on G on 


(d z — A on ) G on — 

(d z — A of f) G 0 ff = 


z — 1 

Ko n G on K 0 « G 0 ff 
z- 1 


(d z — A on ) G on = — (d z — A of f) G 0 ff. 


(S3) 


(54) 

(55) 


(S 6 ) 
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To proceed further, it is useful to define the quantity H s (z) related to the generating function G s (z) by 

G s (z) = e A ‘ z H s {z). 

Using 


(S7) 


(d z - A s S jG s (z) = e A ‘ z 8 z H s {z ), (S8) 

Eq. (IS6l) becomes 

e A °" z d z H on (z ) = - e A °* z d z H oS (z ), (S9) 

which links the expressions for H on and H a g. At this point the initial equation for the steady state (Eq. (IS3I) 1 becomes 

(z - 1 )e A ° z d z H s (z) + K s e A ° z d z H s (z ) = K- s e AsZ d z H- s {z). (S10) 

Multiplying by e As , taking the derivative with respect to z, substituting Eq. (IS9l) . and defining AA S = A s — A s , gives 
d z H s (z) - A A s (z - 1 )d z H s (z) + (z - 1 )d 2 z H s (z) - K s AA s H s (z ) + K s d z H s (z ) = - K s H s (z) 

and hence 

(z - 1 )d 2 z H s {z) + (l - A A s (z - 1) + K s + K^d z H s {z) - K s AA s H s {z ) = 0. 

Finally, changing variables to u = A A s (z — 1) provides 

ud 2 z H s (u ) + (1 + K S + K s - u) d z H a (u) - K s H s (u) = 0. (Sll) 

This is the confluent hypergeometric equation, for which the solution in terms of confluent hypergeometric functions 
of the first kind is given by 


H s (u ) = c s \Fi(K s , 1+K S + K s \u ), 
with c s a constant of integration. Thus, through Eq. (1S7II . 

G a {z) = c s e AsZ i F^Ks, 1 + K S + K- s - AA s (z - 1)). 
To determine the constants, notice that iFi(a, 6,0) = 1 leading to 


(512) 

(513) 


G s ( 1) = c s e As = {p s ) = 


K, 


Ks + I< s ' 

where (p s ) is the average probability of being in state s. Rearranging terms, we obtain 


Ks 


-A, 


K-s + K s 

Finally, the probability distribution at steady state is given by !1| 


Ga{z) = Age ^ ( ~ / ) lFl (K a , 1 + K S + K s - A K s 2 (z - 1 )). 
As + A s 


(S14) 


(S15) 


Having an analytic expression for the steady-state probability distribution (Eq. IS15I) . we can now calculate the first, 
second and third moments, which are related to the mean, variance and skewness, respectively. The mean production 
of the output protein is given by the mean production in the on state multiplied by the probability to be in the on 
state, averaged over the whole time period. For such a two-state system (p on ) = K and (p 0 g) = 1 — ( p on ). 

Therefore, the mean number of proteins is given by 


(K) — (A on Aoff) (Pon ) T A 0 ff' — 


a k+c/k- 


71 + k+c/k- 

To calculate the variance, we use the following property of the generating function: 

(Snf = ( d z zd 2 G s (z )) | z=1 - (nf . 


(S16) 


(S17) 
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Proof. 


i Sn ) 2 = Y ^n 2 p s {n) - (n) 

s In 

= Y J2 n2 ps( n ) -( n > 

sin J z= i 

= Y ^2 zd - i. n Ps{n)z n ) n 2 p s {n) - (n) 
sin J z= i 

= Y [zd z zd z G s {z)] z=1 - (n) 

S 

= Y i d zzd z G s {z )] z= i - (n). 

S 

Using common properties of hypergeometric functions, the analytical solution for the variance is lli| 

a 2 k+c/k 


(Snf) = (n) + <p on > M = (n) + 


1 + AT S + K. 

For details, see the full calculation in the SI of [T|. 


7 (7 + k- + k+c) (1 + k+c/k-) 2 


□ 


(S18) 


Third moment 


In order to understand more about the symmetry of the probability distribution, we calculate the third moment at 
steady state. As in Eq. (IS17I) the third moment can be found via generating functions as 


(' n 3 ) = Y [' d z zd z zd z G s (z )] = Y [3 zd 2 G s {z) + z 2 d 3 G s (z ) + a„G s (z)] 

Z ' Z— 1 Z ' 


Z — 1 


where [l] 


y ]d z G s (z) =(n), 

Z ' z=l 

S 

Y (zd 2 G s (z)) [ =i = (p on > (A on ) 2 + (p off ) (A off ) 2 - (p on ) ( PoS ) 


a 2 {k+c/k ) 


+ 


fc(fc + e 


7 2 (1 + k+c/k-) 7(1 + k+c/k-){ 7 + fc_ + fc+c) 

Thus, only z 2 d 3 G s ( 2 :)|_needs to be calculated. The result is 

(Pon) (Poff) (AA on ) 2 (Aon + AT Q ff) 


Y ( Z 2 d z G s {z )) = (A on ) 3 (Pon) + (A 0 ff) 3 (p 0 ff) ~ 

z ' z=1 


1 + Aon + AToff 


(3 + Aon + 2A'off) Aon (3 + 2A'on + AToff) Aoff 


2 + ATon + Aoff 


2 + Aon + AToff 
a 3 {k+c/k-) (3y + fc + 2fc + c) 


a 3 {k+c/k-) 

7 3 (1 + k+c/k-) 7 3 (1 + k+c/k-) (7 + k- + k+c) ( 2 y + k- + k+c) 


(S19) 


(S20) 


(S21) 


(S22) 


By combining Eqs. (S57)-(S59) as indicated in Eq. (S56), we obtain the analytic expression for the skewness of our 
system. 
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Proof. From the definition of confluent hypergeometric functions of the first kind 


1 F 1 {a,b;z) 


OO 



with 


a n = a{a + l)(a + 2 )...(a + n — 1), 
b n = b(b + 1)(6 + 2). ..{b + n — 1), 


and the fact that 


zd z 1 F 1 (a,b;z) = z- iFi(a + 1, b + 1; z), 
b 


we obtain 


9,G S (*) = ,, Ks A s e A ^~ !) rFr (•, •, AA S (* - 1)) + 


K g + K s L 


AA s Ks 


1 + A% + K s 


e A s (z-!) lFl ( +j+jAAs (z-l)) 


where AA S = A s — A s and ii 7 ’i(+, +, z) = iF 1 {a + 1, b + 1, z). We now need to calculate z2 d z G s {z )| r 

Eq. (IS21I) we find that 


(523) 

(524) 
Using 


(z 2 dlG s {z)) 


z 2 Kg 


-d z 


((A s ) 2 rFi (-, AA s {z - 1)) + 1 F 1 (+, +, AA S (* - 1)) 


S I JV S 


(A A s ) 2 Ks ( K s + 1) 


(1 + K s + Kg) (2 + K s + Kg) 
Differentiating and using property (IS23jl . we obtain 

z 2 K 


1 F 1 (++,++,AA s (z-l)))e A ^ z - 1 ) 


(S25) 


Z = 1 


( z 2 dlG s {z )) 


_ i£_ e A.(*-i) 

2=1 Kg + it's 

, 3AA S K S {A S ) 2 


+ 

+ 


(1 + K s + Kg) (2 + + Kg) (3 + K s + Kg) 

Evaluating at z = 1, we obtain 

Kg 


(AsT iFi(-,-,AA s (^-l)) 

i^i (+) +i A A s {z — 1)) 

l-Fi (++> ++) A A s {z — 1)) 

l-Ff (+ + +, + + +, A A s {z — 1)) 


1 + K s + Ag 
3{AA S ) 2 K S {K s + 1) K s 
(1 + Kg + I<g) (2 + K s + Kg) 

(AA S ) 3 K S {K s + 1) {Kg + 2) 


z= 1 


(z 2 d 3 G s {z)) 


2=1 Kg + A s 


M.)» + U {A ,f + AAfilA U + AA - (K ■ + 2) 


1 + K s + Kg 


3 + K s + K s 


Finally, summing on the possible states of s we arrive at Eq. (IS22jl . 


(526) 

(527) 

□ 


SMALL-NOISE APPROXIMATION TO RAMP SENSING 

Input noise 

In the Model section of the main text, we built a model for a single receptor/ion channel that encodes information 
from an cell-external environment in some cell-internal degrees of freedom. Similarly to Q, we assume that the 
receptor/ion channel activity {r{t)) is a two state system: on with r = 1 when the receptor is bound or the channel 
open, and off with r = 0 when the receptor is not bound or the channel is closed. The external concentration 
(c(t)) is assumed to affect the unbound/closed time interval (t u ) = [k + c{t)] 1 but not the bound/open time internal 
(T&) = AT 1 , where k + and k_ are both constants. Both interval durations are assumed to be independent, exponentially 
distributed random variables. The independence of binding and unbinding (or equivalently of opening and closing) 
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means that the probability of a molecule binding the receptor a second time is negligible. We therefore assume the 
system to be in the fast diffusion regime. 

The signaling rate, called u, implements two different mechanisms of encoding, either continuous (CM) or bursty 
(BM) modulation. CM and BM ultimately correspond to amplitude (AM) and frequency (FM) modulation, respec¬ 
tively, when generalized to multiple receptors/ion channels as explained in the Results section of the main text. In 
CM the proteins are produced with a constant rate a during the binding time. On the other hand, for BM a burst of 
C proteins is realized at the time of binding, so 


u{t) = 


a r(t) 

C ZS{t-tf) 


for CM 
for BM, 


(S28) 


where ak _ = £ and tf the binding times. By taking the average of the rate u(t) over a time t much longer than 
both the average bound time, ( 77 ,) = kZ 1 , and the average unbound time, (r u ) = [k+c(t)] , but shorter than the 

time during which the external concentration changes, we obtain 


, . .. . k + c(t) 

=( M + k+c(t)/k- 

(< Su(t )) = 0, 

k+c(t) 


(.5u{t)5u{t')) =g C 


(1 + k + c(t)/k-)' 


■S( t-t’), 


9 = ' 


2 for CM 

1 + [k + c(t)/k-] 2 for BM, 


(529) 

(530) 

(531) 


which become Eqs. (??), (??) and (??) in the main text by setting £ = 1. (See Supplementary Information in Q for 
further details). Importantly, <7bm < <?cm since k + c(t ) < fc_, i.e. (r^) < (t u ). 

By considering an external concentration given by Eq. (??) in the main text, 


c{t) = 


co + Ci t, t > 0 
c 0 , t < 0, 


with c±t <?C Co, Eq. (1S29I) becomes 


u(t) = C 


uq + u\t + 5u{t) 1 f>0 
uq + Su(t), t < 0, 


where we assume 6u(t ) -C uq + u\t and 


u o = 


Ui = 


fc+cp 

(1 + fc+Co/fc-) ’ 
fc+Ci 

(1 + k + c 0 /k-) 2 


„„=(< i+ Kc' [ r 9cM "° + g r (1 ■ 

I (i+fcL/Lp [3bm“o + (1 - 2fc + c 0 / k _ + 3 k + c 0/ 


(Su(t)Su(t')) 


t,t'< o 


(l + fc+Co/fc-) 

guo 

(1 + k + cp/k-)' 


for CM 
/fc?.) u\t\ for BM, 


: 5(t - t'). 


(532) 

(533) 

(534) 

(535) 

(536) 


Here (?cm = 2 and g^ M = 1 + ( k + c 0 /k _) 2 (cf. Eq. (??) in the main text). Again for ( = 1, this becomes Eq. (??) 
in the main text. From Eqs. (IS32I) - (IS36I) . the constant (t < 0) and ramp (t > 0) regimes for the external species c 
are encoded in the rate u in the corresponding regimes since the condition cR -C Co ensures u\t -C up. However, to 
satisfy condition 5u (it) for both CM and BM, a new condition is needed: 


<7cm/bm 


which implies 


fc+co(l + k+cp/k-) 
fc_, k + c 0 S> r c _1 


< T c 


(S37) 


(S38) 
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Here, we have introduced the correlation time of white noise, r c , corresponding to the 5-function used in Eas. (IS35l) 
and (1S36I) . Note that condition in (IS38I) restricts our study to the fast switching regime. Finally, the signaling rate 
u in the constant regime has one small term Su/uq of order 6 which is defined by Eqs. (1S32I) and (IS36I) . Instead, 
small-ramp regime u contains two small terms: the small-ramp term uit/uo of order e and the small noise term Su/uo 
which now has a correction to order 5 coming from the small ramp (order e). With these definitions, from Eqs. 
(IS32MS35I) the rate u in the small ramp regime has two small corrections to the constant rate uo 


i(t)=Cu 0 [ 1 


U\t 

Su 

Uo 

UO, 

o(e) 

°( ,5 ( 1 +Ve)) 


(S39) 


In order to linearize around linear solutions, we further assume that the small-noise amplitude is smaller than the 
small ramp. As a result, o(5) ~ o(e x ) with x > 1, which means that 

g{ 1 + k + co/k-)k + co < t c (k + cit) 2 . (S40) 

Note that for simplicity, both in the following sections and in the main text, we set ( = 1. 


Output noise in incoherent feedforward loop 


Average solutions for ramp sensing 


Eqs. (??) and (??) in the main text for the incoherent feedforward loop for f(u) = e bu and g(y) = e bkyV become 

(S41) 


dx 

— = k x 
dt 

dy , 

s = u - k ‘ y ■ 


e b(u-k yV ) _ x 


(S42) 


Here, b is a constant introduced to maintain the exponent unitless, and k x and k y are rate constants for x and y. 
This system of equations performs exact adaptation. The steady-state solution in the constant regime (t < 0 in Eq. 
(EMI) is 


(x{t)) = 1, 


<y(*)> = 

ky 


(S43) 


which sets the initial conditions (x(0)) = 1 and (y( 0)) = uo/k y for Eqs. (IS41I) and (1S42I) in the ramp regime (t > 0 in 
Eq. ??). With these initial conditions, the solutions for t > 0 can be written as 


c(*)> = 


bui /'*' j ./ bu i — 

-~ kxt k r e^y I 


dt * 


/o 


{m = v~¥ + v t+ ¥ e ~ kyt ’ 

rvy rvy rvy rvy 


(544) 

(545) 


where the integral in the expression for ( x(t )) cannot be solved analytically. However, by assuming that the integral 
starts from time e ^ ky 1 , Eq. (IS44I) becomes 


bu i 

(x(t)) ~ + e _fcx ^ _e ^ 


(x(e)) — e ky 


Finally, by considering t such that t — e k x 1 and without exceeding the small-ramp regime ( e.g. k x , y !§> 1 and e 
small), the solution becomes Eqs. (??-b) in the main text, 

j»“i 

e ky , 

Uo _ Ui Ul, 

/■’ h 2 ' h ' 

tLy n y hjy 

These solutions match numerical results shown in S4A Fig. Note that the time interval over which these solutions 
are valid extends from a time larger than the transient time to around a time that does not exceed the small-ramp 
regime. These criteria also set the regime of validity for our next results. 


{x{t)) = 

(y(t)) = 
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Output variances in ramp sensing 


Above we gave the average solutions for the incoherent feedforward loop, both in the constant regime (t < 0, Eq. 
(|S43|0 and in the ramp regime (t > 0, Eqs. (IS44[) and (IS45I) 1. Now we want to linearize the equations around these 
solutions in order to obtain information about the noise. We assume that the input noise ( 8u) is smaller than the 
ramp, Eqs. (IS38I) and (IS40I) . which translates into small output noise (Sx and Sy). In addition to these assumptions, 
we also assume b ~ u~ x ; 
for Sx and Sy become 


u Q * in order to ensure b(5u — k y Sy) <C 1. Hence, in the ramp regime, the differential equations 


d(5x) 
dt 

d(Sy) 

dt 


— k x 


be k y (Su — k y 5y) — Sx 


= Su — k y Sy. 


(547) 

(548) 


By defining X(t) = 
small-ramp regimes as 


where 


, Eqs. (IS47I) and (IS48I) can be rewritten in a compact way for both the constant and 
dX(t) 


dt 


+ M(t)X(t) = 


A(t)Su{t) 

5u(t) 


(S49) 


M(t) = < 


kx k x k y b 


k x k x k y b eN 


t < 0 


t > 0, 


(S50) 


and 


m = 


k x b, 

k x b t 


t < 0 

t > 0. 


(S51) 


Note that M[t) (for t > 0) is independent of time, which allows Eq. (IS49I) to be solved analytically. This is due to 
our choice of f(u) and g(u) in Eqs. (??) and (??) in the main text. 

For the constant input regime, t < 0, the solutions for CM and BM are 


(S (tA 2 \ — 9 gm/bmS 2 k 2 n 0 

1 X[ >> / 2(kx + k v )(l + k + c 0 / 


(Sy(t)) 2 ) = 


2 (k x + k y )(1 + k + c 0 /k-) 2 ’ 
Scm/bm^o 
2k y (l + fc+co/fc-) 2 ’ 


(552) 

(553) 


where gcM = 2 and (?bm = 5bm = 1 + ( k+co/k _) 2 . Hence, in the constant regime the output noise for BM is lower 
than the output noise for CM since /c+co < fc_. 

For the small-ramp regime, t > 0, Eq. (IS49I) is analytically solvable for t k y 1 by evaluating the integral from time 
e k ~ 1 to some time t that does not exceed the small-ramp approximation (as discussed for the average solutions). 
With these assumptions and by using an appropriate integrating factor, the solution for X(t) is 


e Mt'^l dt ' + 


dt 1 

X{t) = e~ Mt 


e Mt 'MX (t')dt' = 


r e Mt ' 

A5u(t') 

L 

Su(t') 


dt' 


„Mt' 


A5u(t') 

Su(t') 


dt' 


0 —M(t—e) 


X(e). 


However, for i-e> k xy (within the limit for t and e as discussed for Eqs. (??,b) the solution is 


X(t) = e 


-Mt 


„Mt' 


A5u(t') 

Suit') 


dt'. 


(S54) 











































By using matrix diagonalization, expressing the noise in u by a delta function in time (Eq. IS35I) , and integrating Eq. 
(1S54D for X(t ) 2 , we find analytical solutions for the variances. The results for CM are 


(fe(f)) 

(#y(t)) 


b 2 k 2 e k v 


cm 2(k x + k y )(l + k + co/k-) 2 
2 \ 1 


(1 — 2fc + co/fc_) . . 

3CMW0 — 2/CM- , , -M 1 + 5Cm( 1 — 2fc + Co/K-)uit 

fix I 


CM 2fcj / (l + /c_|_Co/fc_) 2 


(1 — 2fc-i_co/fc-) . . . 

ffCMWo -ffCM -:- Ml +5cm(1 - 2k+co/k-)u\t 

ky 


where (/cm = 2. For BM, the (/ B m parameter (see Eq. (??)) affects the integration, and the results are 


(555) 

(556) 


( (fa( ‘ ))2 ) B M = 


b 2 kie^~ 


bm 2(k x + k y )(l + k + co/k-) 2 


9 BM u 0 


1 — 2k+co/k + 3fc+CQ/£r 


k x + k y 


Mi + (l — 2kj r co/k- + 3fc^.Co/fc^) uit , (S57) 


2 \ 1 
( 2/(0) / BM 2k y (l + fc+co/fc-) 2 


5bm u o 


1 — 2k+co/k- + 3fc+Co/fc;l 
2 ky 


Mi + (l — 2k + co/k _ + 3fc+Cg/fc^) Mit 


(S58) 


where g BM = 1 + ( k + co/k _) 2 . Note that for Ci = Mi = 0, the solutions coincide with the solutions for the constant 
regime. Furthermore, by comparing the time-dependent terms, CM is noisier than BM when fc+co < \k-. In our 
model this is due to the input noise (cf. Eq. IS35I) . These two regimes in which BM is less noisy and hence more 
accurate than CM depend on the ratio of binding and unbinding rates as shown in S4B,C Fig. Clearly the analytic 
solutions match numerical simulations with noise. All these calculations were done using Wolfram Mathematica 8, 
while all the simulations of the stochastic differential equations (Eqs. IS41l and lS42l) were done using the Euler method 
in MATLAB. 


Output noise for integral feedback loop 

A similar approach can be applied to the integral feedback loop given by Eqs. (??) and (??) in the main text, 
shown here for clarity with f(y) = e~ by : 

dx 
dt 
dy 
dt 

Assuming that u is given by Eq. (IS32I) . this system does not have analytic solutions in the ramp regime. However, in 
the small-ramp regime it is possible to linearize around the solutions of the constant regime. Hence, ( x(t )) = x$ +e x (t) 
and (y(t)) = yo + £y(t), where Xo = 1 and yo = ln ( M o/ fc ») are the solutions for the constant regime with (u) = uq. 
Note that the condition k x < mq is required. By linearization, Eqs. (??) and (??) become 


Me by — k x x, 

(S59) 

k y (a; - 1). 

(S60) 


= k x — - k x e x (t ) - k x be y (t) - bk x —e y {t)t, 
at uq uq 

de y (t) 


dt 


= k y e x (t). 


(561) 

(562) 


Combining both equations and neglecting the second-order term uit/uoe y (i), it possible to find a second-order differ¬ 
ential equation for e x (t), given by 


d 2 e x (t) de x (t) () _ k xUl 

I r^X ,, I Urvxrvy \^) — 


dt 2 


dt 


Mq 


(S63) 


The solution is 


£x(t) = 


Ml 

bk y uo 


Ci exp 


^ - bk x k y j t 


+ C 2 exp 


y - bk x k y j t 


(S64) 
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with e x (t) —»■ fcfc Ml after a transient time defined by the exponential terms for any fc 2 /4 — bk x k y . Furthermore, there 
are two integration constants C\ and C 2 . From Eq. (IS62I) we obtain e y = -j^t — ^ 1 UQ ■ Finally, the solutions of 
linearized Eqs. (??) and (??) in the small-ramp regime after the transient time are [ 2 ] 


( x(t )) = 1 + 


(y(t)) =yo- 


ui 

bk y Uo ’ 

Ml 


u 1 

-I- —t. 

b 2 kyUo buo 


(565) 

(566) 


Within the small-noise approximation (Eq. IS38[) . we want to find expressions for the variances. In the constant 
regime, u(t) = Uq + 5u(t) (t < 0 in Eq. 5) implies x(t) = 1 + 5x(t) and y(t) = yo + Sy(t). Therefore, the equations for 
the noise terms become 


d(8x) 

dt 


Su 

_ Uq 


d(Sy) 

dt 


k x Sx. 


buo8y — Sx 


(567) 

(568) 


Proceeding similarly to the incoherent 


feedforward loop, in the constant regime the solution for the variances are 


i 


{(Sy) 2 ) 


ffCM/BM&x 

2 (1 + k+co/k-) 2 u 0 ’ 

ffCM/BM ky 

2b (1 + k+Co/k-) 2 Uq 


(569) 

(570) 


with 5 cm = 2 and 5 bm = 5bm = 1 + (fc+co/fc-) 2 • Hence, in the constant regime, the output noise for BM is lower 
than the output noise for CM (since fc + co < ft_). 

To study the system in the small-ramp regime (t > 0 in Eq. 5), we assume that the input noise (Su) is smaller than 
the ramp (Eqs. IS38I and IS40I) . which translates into small output noise (Sx and Sy), and linearize around solutions 
(1S65I) and (IS66D . As a result, Eq. (??) becomes 


d (Sx) 
dt 


U\t 

Uq 


^ (l-b (e y +Sy)+ h — (e y + Sy) 2 ^ 



which, by using Eq. (1S61L becomes 


d (Sx) 
dt 


= k x b 


Su 

u 0 


Ml U\t 

Sy - £yt - Sy 

Mo Mo 


^Su - 
M 0 


K 


be v Sy 


Sx 

~b 


5 ( e3 ) S 2 , e 2 S) 


(S71) 


where we neglect third-order terms in the small ramp (o(e 3 )), second-order terms in the small noise (S 2 ) and mixed- 
order terms (o(e 2 S)) due to the assumption that the noise is smaller than the ramp (cf. discussion that leads to Eq. 

»). 

A rp 

, Eqs. (IS71D and (IS60I) become 


Defining X(t) = 


Sy 


dX(t) 

dt 


M(t)X(t) = 


A(t)Su(t) + B(t) 
0 


(S72) 


where from Eqs. (IS71I) and (IS60I) . using definitions of e x and e y , M(t) = 


k x b 


rv x rv x 

-k 


(l+ bui_) 

\ KyUQJ 


A(t) = 


kx_ 

Uq 


1 + 


kybUQ Uq 


t^ and B(t) = - t 2 ^j. Using an integrating factor and integrating between e and t 


gives 


X(t) = 


- , 


} X(e) 


-Mt 


dz e Mz 


A(z) 


+ e 


-Mt 


dz e Mz B(z) 


(S73) 
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where the term e ^A'(e) is negligible for (t — e) k x l y . To calculate the variances we square Eq. (IS73I) . Using 


Eqs. (S5)-(S9), the results for ( ( 5x(t )) ) to first-order in the small-ramp parameters are 

kx 


(6x(t)) 

(Sx{t)) 


cm 2 (1 + k+co/k-} u 0 l 
2 \ kx 


Ult 2k x + bky(l + 2k + c 0 /k-)u 1 

g CM - g CM (1 + 2k + Co/k-) -1- 3CM- 7-T-, - 

u 0 bkyk x u 0 


bm 2(l + k+co/k-) uq L 


ffBM - (! + 2,k+co/k- - k\cl/k _ 2 ) — 

Uq 

( bk v (l + 2k + c 0 /k- - k\cl/kZ 2 ) + 2k x g^ M ) u\ 
bk x k y u 0 


Similarly the results for (( by ) 2 ) are 


, (S74) 


(S75) 


(6y(t)Y 


cm 2b (1 + (r b ) k + c 0 ) u 0 


gcM — Scm(1 + 2k + co/k-) — 

u 0 


+ gcM 


(kx( 3 + 2fc + co/fc_) + 2k y b{\ + 2k+co/k-)) ul 


2bk x k y UQ 


(Sy(t)Y 


BM 2b (1 + (r b ) k + c 0 ) u 0 


3bm - (l + 2 (r b ) k+c 0 - (r b ) 2 k\ eg) — 
V / M 0 


+ 


2 bk y (l + 2 (n) k + c 0 - {n) 2 k\c^j + k x (^3 + 2 (r b ) k + c 0 + (n) 2 k+c^J 


u 1 


bkykxUo 


(S76) 


, (S77) 


where = 1 + (fc+Co/fc-) 2 . Note that for ci = u\ = 0, the solutions coincide with the solutions for the constant 
regime. Although it is clear that BM is less noisy than CM for k + c o < k_, by comparing the time-dependent terms 
we find that, in fact, BM is always less noisy than CM. The analytical solutions are plotted in |S5 Fig] and match 
the numerical simulations with noise. Again, all these calculations were done using Wolfram Mathematica 8, while 
all the simulations of the stochastic differential equations (Eqs. IS59I and IS60I) were done using the Euler method in 
MATLAB. 


FURTHER INVESTIGATIONS INTO THE ACCURACY 

In this section we provide further explanations for the accuracy of concentration sensing by a single receptor 
without comparing with the maxmimum-likelihood estimation jdj ■ In Fig. ?? we showed results from the master 
equation for the two regimes k + Co < k- and /c+co > A;_ for slow and fast switching of the receptor. Despite its 
burstiness, the BM receptor turned out more accurate than the CM receptor in the fc+co < k- regime for fast switching. 

Additional results from the master-equation model. To understand this result better we also implemented an 
intermediate-modulation (IM) receptor, which has features of both the CM and BM receptors. Like the CM receptor, 
the IM receptor signals while in the bound (on) state, but instead of a constant rate a of production it produces 
protein with a rate a' so that in each bound interval the same number of molecules are produced irrespective of the 
interval length, i.e. a'r b = £, with ( the constant burst size of BM. For this to work, the IM receptor would have 
to know at the time of binding when it will unbind again, in order to choose the correct rate of production. Since 
the rate of unbinding is a random variable this is generally not possible. Nevertheless, the IM receptor may help to 
further elucidate our observed trends in accuracy. In practice, we implemented this IM receptor by first simulating 
a time trace of bound and unbound time intervals with a Gillespie algorithm, allowing us to determine the rate of 
production as a function of time. Afterwards, the actual protein production and degradation were simulated. 

In analogy to Fig. ?? the results for the IM receptor are shown in |S1 Fig] (green lines), which also shows the 
results for the CM and BM receptors for comparison in blue and red, respectively. As expected, for slow switching the 
IM receptor has intermediate accuracy between CM and BM. CM is most accurate as continuous production during 
the bound intervals is balanced by degradation so the output protein level does not fluctuate excessively. BM is least 
accurate due to the increased burst size for slow switching. Since signaling by the IM receptor is only burst-like for 
the short bound intervals but not for the long bound intervals, it is somewhat more accurate than BM. Due to the 
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non-constant rate of production, IM also fluctuates more than CM. This intermediate accuracy is clearly demonstrated 
by the time traces in the left panels of |S2 Fig] 

In the A;+co < k- regime for fast switching, the inset of SIC Fig. shows that BM is now most accurate and that IM 
has again intermediate accuracy. While BM steadily produces the same amount of protein at the times of binding, 
IM produces this amount only during short bound intervals as its rate of production is then high, while during long 
bound intervals its slow production is buffered by degradation, so its protein level fluctuates more strongly. CM is 
even worse than IM since, due to its constant rate of production during bound time intervals, it hardly produces any 
protein during short bound intervals, which leads to drastic drops in protein level, while it produces a lot during long 
bound intervals due to its constant rate of production. 

In contrast, in the fc+co > k- regime for fast switching, CM is generally most accurate due to its approximately 
constant rate of production throughout time, i.e. the receptor is almost always bound and active. IM is less accurate 
than CM because its rate of protein production is variable due to the variable length in bound intervals, despite 
the fact that the receptor is mostly bound. Interestingly, IM is even less accurate than BM under these conditions. 
Inspecting the examples of time trace in the bottom right panel of |S2 Fig] , the burst sizes of IM can exceed the burst 
sizes of BM for unusually short bound intervals since production is very high and stochastic, and only on average the 
same amount of protein is produced during bound intervals than during a burst in BM. During long bound intervals 
the rate of production is very low. Hence, compared to BM, degradation prevents a net increase in protein level 
during a bound interval, leading to further variability. A special case is when the burst size £ is 1. As shown in the 
inset of Fig. ??D, BM can be more accurate than CM. This is because the burst size of BM is minimal and in the 
master equation the production with minimal rate a in CM is highly stochastic. 

As we now discuss, to provide further intuition for the differences in accuracy between the fc+co < k- and fc+co > k- 
regimes, we also simulated the variance of the signaling output (and hence the accuracy-determining factor g) directly 
(see Eq. 5). 

Signaling output from ODE model without protein production and degradation. Factor g in Eq. 5 (and 
Eq. S31) determines the variance of the signaling rate u(t) without invoking any downstream protein production 
and degradation. For a given time interval At, we can hence simulate u(t) directly. We assess the accuracy of CM, 
IM, and BM by plotting the histograms of the integrated signaling rate ui(At) := f Q u(t)dt and by determing their 
variances (cf. derivation of g in [2]). As slow protein production and degradation strongly affect the accuracy of the 
final protein output for slow switching, this approach mainly helps understand the interesting fast switching case. 

We initially assume signaling during bound intervals is deterministic, leading to a linear increase of u with slope a 
(a 1 ) during a bound time interval for CM (IM) and a step increase by ( for BM. At each unbound time interval, IM 
and BM have the same level of signaling output as IM produces the same number of proteins deterministically during 
each bound interval (£). In contrast, the signaling output from CM is generally different since the rate of signaling is 
always the same for each bound interval but their durations vary. Resulting time traces and variances are shown in 
S3A and B Figs, left panels, respectively. Specifically, S3A Fig., left panels shows clearly that for k + co < k- BM and 
IM are most accurate with ui(t) increasing almost linearly in time. Since signaling is deterministic, BM and IM are 
essentially identical, and their variance may only differ due to small differences in signaling during the final bound 
interval (S3A Fig., bottom left panel). This last bound time interval may be interrupted in IM, but for long At this 
difference is negligible. In contrast, S3B Fig., left panels show clearly that for fc+co > fc_ CM is most accurate, as 
ui(t) is now almost linear in time. 

Signaling output from master-equation model without protein production and degradation. Allowing 
signaling to be stochastic does not change the results for the accuracy significantly. S3A Fig. right panels show that 
for fc+co < fc_ BM is now most accurate and that IM has intermediate accuracy (between BM and CM) due to its 
variability in signaling in line with SIC Fig. Additionally, S3B Fig., right panels show that CM is still most accurate 
but also that IM is worse than BM in line with SID Fig. 

Taken together, these additional simulation results confirm our findings of the main text that BM is most accurate 
for fc+co < k- and CM is generally most accurate for fc+co > fc_. 


AM IS MORE ACCURATE THAN FM FOR MULTIPLE RECEPTORS/ION CHANNELS 

Here, we provide a more detailed discussion of the accuracy of encoding by multiple receptors, i.e. using AM and 
FM. To determine whether AM or FM is more accurate in encoding and decoding, we generalize to multiple receptors 
(or ion channels) ( |S6 Fig| ). We assume that AM is obtained by unsynchronized CM receptors (S6A Fig.), while FM 
is obtained by synchronized receptors that individually operate with BM (S6D Fig.). Other types of synchronization 
are also possible with synchronized CM receptors shown in S6B Fig. and unsynchronized BM receptors shown in 
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S6C Fig. However, these receptors exhibit imperfect FM: resulting bursts have either variable duration (S6B Fig.) or 
variable amplitude (S6C Fig.) in contrast to the data (Fig. ??) [5]. 

To estimate the accuracy, we first consider perfect synchronization and unsynchronization in either modulation 
scheme. For N unsynchronized (us) receptors, we can express the resulting average and variance of the encoded 
input by the single-receptor quantities, i.e. ( u(t))™ = N (u(t)) 1 and ( 6u(t)5u(t’))™ = N (8u(t)6u(t')) 1 . As a result, 
the relative variance (variance divided by the average-squared) scales with N -1 . In contrast, for N synchronized ( s) 
receptors, the average and variance of the encoded input can be written as ( u(t)) s N = N (u(t)) 1 and (8u(t)8u(t')) s N = 
N 2 (5u(t)8u(t')) 1: respectively. Hence, the relative variance is now independent of TV, so unsynchronized receptors 
have an N times smaller noise than synchronized receptors. Since N unsynchronized CM receptors lead to AM, we 
obtain for its relative variance 


( Su(t)6u(t'))^ M (<5w(t)<5w(t , ))i' M 

(m o>r ) 2 = *( W o>? M ) 2 


Conversely since N synchronized BM receptors lead to FM, the relative variance of FM is 


(Su(t)5u(t'))^ M (Su(t)Su(t'))f M 

(< u ( t » r ) 2 " ( m *)>? m ) 2 


(S78) 


(S79) 


For slow dynamics, or fast dynamics with k+c > fc_, CM is more accurate than BM. Hence, for N receptors, AM is 
even more accurate than FM. In contrast, for fast dynamics with k+c < k_, BM is up to twice as accurate as CM 
(Eq. (??)), and AM is N times more accurate than CM. Consequently, AM becomes more accurate for encoding than 
FM for more than two receptors (S6E Fig.). An exception are two receptors, for which AM and FM can be equally 
accurate (S6E Fig., inset). Since we generally show that larger signaling noise leads to larger output noise, the same 
rule emerges for decoding. 

To extend our results to intermediate levels of synchronization for N > 2 receptors we consider a fraction p of 
synchronized receptors while the remaining fraction (1 — p) are unsynchronized, with signaling either by CM or BM 
(S6E Fig.). When comparing CM and BM receptors for the same levels of synchronization p, BM receptors can 
remain more accurate than CM receptors (S6E Fig.). However, intermediate levels of synchronization do not strictly 
represent AM and FM. As shown in S6B,C Figs, synchronized CM receptors lead to pulses of variable duration, while 
unsynchronized BM receptors lead to highly frequent pulses with potentially variable amplitude. 

Taken together, since single cells have thousands of receptors and ion channels, AM is the most accurate modulation 
scheme. 
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k + c o< k- 


k + c o> k- 


Slow Fast 


Slow Fast 







Frequenc y / 


Frequency / 


SI Fig. First three moments of the protein distribution in concentration sensing from the master equation. 

Averages (A,B), variance (C,D), and skewness (E,F) as a function of the frequency of binding events, / = fc+co/(l + fc+co/fc-). 
(Insets) Magnification of small-noise approximation region (fast switching). Analytical results for CM (blue) and numerical 
results for BM (red) and intermediate modulation IM (green) as function of the frequency of binding events (logarithmic scale). 
Note that this figure is similar to Fig. ?? in main text with the addition of IM. Two regimes are shown: k- = 10 fc+co 
(a = 100 s ” 1 ,7 = Is” 1 , £ from 1000 to 1 ) (left column) and = 0.1 k + co (a = 10 s ” 1 ,7 = Is” 1 , £ from 1000 to 1 ) (right 
column). Averages from CM, BM and IM are constrained to be equal, i.e. C, (BM) = akZ 1 (CM) = a'Tb (IM). Variances of 
CM, BM and IM exhibit two different regimes for fast switching: for A;+co < k- BM is the most accurate mechanism and CM 
the worst (inset in C) while for fc+co > k- CM is generally the most accurate (except for £ = 1) and IM the worst (inset in 
D). Third moments show that, for large noise, the probability distributions become asymmetric. 
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Slow 



Fast 





S2 Fig. Examples of time traces of receptor activity and protein copy numbers for different regimes. (Top) Regime 
k+co < k _ with fc+c = 0.1 k- (a = 100s _1 ,7 = Is -1 ). (Bottom) Regime fc+co > k- with fc+c = 10 k- (a = 10s -1 ,7 = Is -1 ). 
(Left) Slow switching with £ = 400. (Right) Fast switching with £ = 7. Receptor activity r and protein copy numbers n(t) for 
CM, BM and IM are shown in black, blue, red and green, respectively. 
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S3 Fig. Investigating accuracy based on accumulative signaling (without protein production and degradation). 

(A) Regime fc+co < fc- with fc+c = 0.1 fc_ (a = 100s _1 ,7 = Is -1 and £ = 7). (Left) ODE model. (Right) Stochastic protein 
production during 77 in CM and IM. (Top) Examples of time traces. (Bottom) Histograms of number of proteins produced 
after 100s with standard deviation in legend based on 1000 simulations. (B) Analogous to (A) but for regime k+c > k- with 
k+c = 10 fc- (a = 100s -1 ,7 = Is -1 and £ = 7). CM, BM and IM are shown in blue, red and green, respectively. 



Time [s] 


Time [s] 


Time [s] 


S4 Fig. Incoherent feedforward loop: Comparison of analytical results with simulations of the stochastic 
differential equations. (A) Averages of signaling rate u (left), species y from Eq. (S42) (middle) and species x from (S41) 
(right) as a function of time. Analytic solutions Eqs. (S32), (S43) and (12) are shown for BM in red, while a (time averaged) 
time-trace from a stochastic simulation using the Euler method is shown in orange (CM is almost identical and hence is not 
shown). (B) Corresponding variances as a function of time for fc+co > k- (k- = 6.7 x 10 5 s -1 , fc+co = 10 6 s -1 ). Analytic results 
are shown in blue for CM and in red for BM; average over time (Is) from numerical simulations are shown in light blue for CM 
and in orange for BM. (C) Corresponding variances as a function of time for fc+co < fc- (k- = 6.7 x 10 6 s -1 , fc+co = 10 6 s -1 ). 
Colors same as in (B). Remaining parameters: fc+ci = 10 4 s -2 , k x = 10s -1 and k y = 50s -1 . 
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S5 Fig. Integral feedback loop: Comparison of analytical results with simulations of the stochastic differential 
equations. (A) Averages of signaling rate u (left), species y from Eq. (S60) (middle) and species x from (S59) (right) as a 
function of time. Analytic solutions Eqs. (S32), (S66) and (S65) are shown for BM in red, while a (time averaged) time-trace 
from a stochastic simulation using the Euler method is shown in orange (CM is almost identical and hence is not shown). 
(B) Corresponding variances as a function of time for fc+co > k- (fc_ = 6.7 x 10 5 s -1 , fc+co = 10 6 s -1 ). Analytic results are 
shown in blue for CM and in red for BM; numerical simulations are shown in light blue for CM and in orange for BM. (C) 
Corresponding variances as a function of time for fc+co < k- (fc_ = 6.7 x 10 6 s -1 , fc+co = 10 6 s -1 ). Colors same as in (B). 
Remaining parameters: fc+ci = 10 4 s -2 , k x = 10s _1 and k y = 50s -1 . 
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S6 Fig. From CM (BM) to AM (FM) for multiple receptors/ion channels. (A-D) Schematic of receptor activity in 
time. (A) AM emerges from N unsynchronized receptors or ion channels in CM mode. (B) N synchronized CM receptors lead 
to a hybrid mechanism with information encoded in the frequency of broad bursts of variable duration. (C) N unsynchronized 
BM receptors provide a dense series of bursts. For large N, bursts may start overlapping, leading to variable amplitudes. 
(D) FM emerges from N synchronized receptors in BM mode. (E) Relative variance for a system of 8 receptors with pN 
synchronized and (1 — p)N unsynchronized receptors, plotted for fast dynamics in the k+c < k- regime (CM in blue and BM 
in red). Letters refer to panel labels (A-D). Dotted red line indicates uncertainty from FM for comparison. (Inset) Same for a 
system of two receptors only. 













































































